Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update latest commits #14

Merged
merged 40 commits into from
Jul 26, 2022
Merged

Update latest commits #14

merged 40 commits into from
Jul 26, 2022

Conversation

datquocnguyen
Copy link
Owner

What does this PR do?

Fixes # (issue)

Before submitting

  • This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
  • Did you read the contributor guideline,
    Pull Request section?
  • Was this discussed/approved via a Github issue or the forum? Please add a link
    to it if that's the case.
  • Did you make sure to update the documentation with your changes? Here are the
    documentation guidelines, and
    here are tips on formatting docstrings.
  • Did you write any new necessary tests?

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

duongna21 and others added 30 commits July 19, 2022 08:13
@duongna21
Remove use_auth_token from the from_config method (#18192)
4bea658 
* remove use_auth_token from from_config

* restore use_auth_token from_pretrained run_t5_mlm_flax
@sgugger
Add vision example to README (#18194)
e630dad
@orgoro
bugfix: div-->dim (#18135)
7983844
@snehankekre
Update docs README with instructions on locally previewing docs (#18196)
ce01528 
* Update docs README with instructions on locally previewing docs

* Add instructions to install `watchdog` before previewing the docs
@patrickvonplaten @sgugger
[From pretrained] Allow download from subfolder inside model repo (#1…
3bb6356 
…8184)

* add first generation tutorial

* [from_pretrained] Allow loading models from subfolders

* remove gen file

* add doc strings

* allow download from subfolder

* add tests

* Apply suggestions from code review

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* apply comments

* correct doc string

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
@sgugger @LysandreJik
Custom pipeline (#18079)
dc9147f 
* Initial work

* More work

* Add tests for custom pipelines on the Hub

* Protect import

* Make the test work for TF as well

* Last PyTorch specific bit

* Add documentation

* Style

* Title in toc

* Bad names!

* Update docs/source/en/add_new_pipeline.mdx

Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>

* Auto stash before merge of "custom_pipeline" and "origin/custom_pipeline"

* Address review comments

* Address more review comments

* Update src/transformers/pipelines/__init__.py

Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>

Co-authored-by: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
@flozi00
Typo in readme (#18195)
9f12ec7
@ydshieh @sgugger
Use next-gen CircleCI convenience images (#18197)
05ed569 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
@gante
TF: Add missing cast to GPT-J (#18201)
ec6cd76 
* Fix TF GPT-J tests

* add try/finally block
@Rocketknight1
Reduce console spam when using the KerasMetricCallback (#18202)
8a61fe0 
* Reduce console spam when using the KerasMetricCallback

* Switch to predict_on_batch to improve performance
@ydshieh
update cache to v0.5 (#18203)
4b1ed79 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
@qqaatw
Fix LayoutXLM docstrings (#17038)
0ed4d0d 
* Fix docstrings

* Fix legacy issue

* up

* apply suggestions

* up

* quality
@oneraghavan
Adding OPTForSeqClassification class (#18123)
dcec4c4 
* Adding OPTForSeqClassification class

* Fix import issues

* Add documentation for optforseqclassification

* Remove checkout

* fix failing tests

* fix typo

* Fix code formatting

* Incorporating the PR feedbacks

* Incorporate PR Feedbacks

* Fix failing test and add new test for multi label setup

* Fix formatting issue

* Fix failing tests

* Fix formatting issues

* Fix failing tests

* Fix failing tests

* Fix failing tests

* Fix failing tests

* PR feedback
@ydshieh
Change to FlavaProcessor in PROCESSOR_MAPPING_NAMES (#18213)
bc6fe6f 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
@ydshieh
skip some test_multi_gpu_data_parallel_forward (#18188)
9edff45 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
@stevhliu
Add custom config to quicktour (#18115)
ff56b8f 
* 📝 first draft of new quicktour

* make style

* 🖍 edit and review

* 🖍 small fixes

* 🖍 only add custom config section

* 🖍 use autoclass instead
@zh-zheng
Update add_new_pipeline.mdx (#18224)
dbfeffd 
fix typo
@viclzhu
Add support for Sagemaker Model Parallel >= 1.10 new checkpoint API (#…
d23cf5b 
…18221)

* Add support for Sagemaker Model Parallel >= 1.10 new checkpoint API

* Support loading checkpoints saved with SMP < 1.10 in SMP < 1.10 and SMP >= 1.10

* Support loading checkpoints saved with SMP >= 1.10 in SMP >= 1.10

* Fix bug and styling

* Update based on reviewer feedback
@CakeCrusher
Better messaging and fix for incorrect shape when collating data. (#1…
5e2f2d7 
…8119)

* More informative error message

* raise dynamic error

* remove_excess_nesting application

* incorrect shape assertion for collator & function to remove excess nesting from DatasetDict

* formatting

* eliminating datasets import

* removed and relocated remove_excess_nesting to the datasets library and updated docs accordingly

* independent assert instructions

* inform user of excess nesting
@nickprock
Translation/debugging (#18230)
9f787ce 
* added debugging.mdx

* updated debugging.mdx

* updated translation

* updated translation debugging

* translated debugging

* updated _toctree.yml
@sgugger
Fix TrainingArguments help section (#18232)
43a5375
@sgugger
Make errors for loss-less models more user-friendly (#18233)
ba552dd
@lorenzobalzani @sgugger
Italian translation of run_scripts.mdx gh-17459 (#17642)
0d971be 
* Run_scripts Italian translation gh-17459

* Updated run_scripts gh-17642

* Updated run_scripts gh-17642

Made the text more gender-neutral.

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
@mfumanelli @sgugger
Italian/model sharing (#17828)
8881e58 
* Add Italian translation of the doc file model_sharing.mdx

* Fix style

* Fix typo

* Update docs/source/it/_toctree.yml

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
@mfumanelli @sgugger
Italian/accelerate (#17698)
07575e8 
* Add 'accelerate' to _toctree file

* Fix 'training with a nb' title

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
@ydshieh
Update notification service (#17921)
2c5747e 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
@sayakpaul @Rocketknight1 @gante
[SegFormer] TensorFlow port (#17910)
561b9a8 
* add: segformer utils and img. classification.

* add: segmentation layer.

* feat: working implementation of segformer.

* chore: remove unused variable.

* add test, remaining modifications.

* remove: unnecessary files.

* add: rest of the files.

Co-authored-by: matt <rocketknight1@gmail.com>

* chore: remove ModuleList comment.

* chore: apply make style.

* chore: apply make fixup-copies.

* add  to check_repo.py

* add decode head to IGNORE_NON_TESTED

* chore: run make style.

* chore: PR comments.

* chore: minor changes to model doc.

* tests: reduction across samples.

* add a note on the space.

* sort importats.

* fix: reduction in loss computation.

* chore: align loss function with that of NER.

* chore: correct utils/documentation_tests.txt

Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>

* chore: simplify the interpolation of logits in loss computation.

* chore: return transposed logits when return_dict=False.

* chore: add link to the tf fine-tuning repo.

* address pr comments.

* address niels's comments.

* remove from_pt=True since tf weights are in.

* remove comment from pt model.

* address niels's comments.

Co-authored-by: matt <rocketknight1@gmail.com>
Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
@muellerzr
Fix no_trainer CI (#18242)
99eb9b5 
* Fix all tests
@alaradirik
Add OWL-ViT model for zero-shot object detection (#17938)
12d66b4 
* add owlvit model skeleton

* add class and box predictor heads

* convert modified flax clip to pytorch

* fix box and class predictors

* add OwlViTImageTextEmbedder

* convert class and box head checkpoints

* convert image text embedder checkpoints

* add object detection head

* fix bugs

* update conversion script

* update conversion script

* fix q,v,k,out weight conversion conversion

* add owlvit object detection output

* fix bug in image embedder

* fix bugs in text embedder

* fix positional embeddings

* fix bug in inference mode vision pooling

* update docs, init tokenizer and processor files

* support batch processing

* add OwlViTProcessor

* remove merge conflicts

* readd owlvit imports

* fix bug in OwlViTProcessor imports

* fix bugs in processor

* update docs

* fix bugs in processor

* update owlvit docs

* add OwlViTFeatureExtractor

* style changes, add postprocess method to feature extractor

* add feature extractor and processor tests

* add object detection tests

* update conversion script

* update config paths

* update config paths

* fix configuration paths and bugs

* fix bugs in OwlViT tests

* add import checks to processor

* fix docs and minor issues

* fix docs and minor issues

* fix bugs and issues

* fix bugs and issues

* fix bugs and issues

* fix bugs and issues

* update docs and examples

* fix bugs and issues

* update conversion script, fix positional embeddings

* process 2D input ids, update tests

* fix style and quality issues

* update docs

* update docs and imports

* update OWL-ViT index.md

* fix bug in OwlViT feature ext tests

* fix code examples, return_dict by default

* return_dict by default

* minor fixes, add tests to processor

* small fixes

* add output_attentions arg to main model

* fix bugs

* remove output_hidden_states arg from main model

* update self.config variables

* add option to return last_hidden_states

* fix bug in config variables

* fix copied from statements

* fix small issues and bugs

* fix bugs

* fix bugs, support greyscale images

* run fixup

* update repo name

* merge OwlViTImageTextEmbedder with obj detection head

* fix merge conflict

* fix merge conflict

* make fixup

* fix bugs

* fix bugs

* add additional processor test
@sgugger
Fix OwlViT tests (#18253)
06d98e2 
* Fix OwlViT tests

* Forgot one
F02934 and others added 10 commits July 22, 2022 13:53
@F02934 @sgugger
Add Italian translation of create_model.mdx and serialization.mdx (#1…
4935409 
…7640)

* First commit

* final changes

* Changed create_model to create_a_model
Translated into crea un'architettura personalizzata in the file it/_toctree.yml

* Added _toctree.yml in the italian translation loca: serialization title Esporta modelli transformers

* Edit translation for create_model.mdx

* t with '#' will be ignored, and an empty message aborts the commit.

* Added file serialization for translation in italian

* Fix toctree serialization position

I checked the eng toctree and realized I made a mistake.

* Update _toctree.yml

Correct spacing

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
@gante
TF: use the correct config with (...)EncoderDecoder models (#18097)
1fc4b2a
@muhammad-ahmed-ghani
change bloom parameters to 176B (#18235)
7cb4da1
@ydshieh
Fix torch version check in Vilt (#18260)
d95a32c 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
@Rocketknight1
Change how take_along_axis is computed in DeBERTa to stop confusing…
0750535 
… XLA (#18256)

* Change how `take_along_axis` is computed in DeBERTa to stop confusing XLA

* Greatly simplify take_along_axis() since the code wasn't using most of it
@amyeroberts
Update serving code to enable saved_model=True (#18153)
8e83846 
* Add serving_output and serving methods to some vision models

* Add serving outputs for DeiT

* Don't convert hidden states - differing shapes

* Make saveable

* Fix up

* Make swin saveable

* Add in tests

* Fix funnel tests (can't convert to tensor)

* Fix numpy call

* Tidy up a bit

* Add in hidden states - resnet

* Remove numpy

* Fix failing tests - tensor shape and skipping tests

* Remove duplicated function

* PR comments - formatting and var names

* PR comments
Add suggestions made by Joao Gante:
* Use tf.shape instead of shape_list
* Use @tooslow decorator on tests
* Simplify some of the logic

* PR comments
Address Yih-Dar Sheih comments - making tensor names consistent and make types float

* Types consistent with docs; disable test on swin (slow)

* CI trigger

* Change input_features to float32

* Add serving_output for segformer

* Fixup

Co-authored-by: Amy Roberts <amyeroberts@users.noreply.github.com>
@gante
Generate: deprecate default max_length (#18018)
7e44226
@ydshieh
Skip passes report for --make-reports (#18250)
bbb62f2 
Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>
@Rocketknight1
Allows KerasMetricCallback to use XLA generation (#18265)
f4e1727 
* Allows `KerasMetricCallback` to use XLA generation

* make fixup

* Slightly reword docstring
@Rocketknight1
Fix TF bad words filter with XLA (#18286)
45a1475 
* Fix bad words filter in XLA generation

* Remove my cool debug breakpoints (again)
@datquocnguyen datquocnguyen merged commit 5c0fdac into datquocnguyen:fast_tokenizers_BARTpho_PhoBERT_BERTweet Jul 26, 2022
@HuggingFaceDocBuilderDev
Copy link

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.