Repositories list

• Open-Sora-Plan

  Public
  This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

  Python

  •

  Apache License 2.0

  •1k•12k•243•17•Updated Dec 26, 2024Dec 26, 2024

• ConsisID

  Public
  Identity-Preserving Text-to-Video Generation by Frequency Decomposition

  video-generatordiffusionvideo-generation+ 5diffusion-modelstext-to-videovideogenerationvideo-generation-datasetidentity-preserving

  Python

  •

  Apache License 2.0

  •28•532•22•0•Updated Dec 26, 2024Dec 26, 2024

• Next-Patch-Prediction

  Public
  Python

  •2•96•0•0•Updated Dec 23, 2024Dec 23, 2024

• LLaVA-CoT

  Public
  LLaVA-CoT, a visual language model capable of spontaneous, systematic reasoning

  Python

  •

  Apache License 2.0

  •60•1.7k•1•0•Updated Dec 12, 2024Dec 12, 2024

• N-LoRA

  Public
  【COLING 2025🔥】Code for the paper "Is Parameter Collision Hindering Continual Learning in LLMs?".

  Python

  •

  Apache License 2.0

  •0•30•0•0•Updated Dec 5, 2024Dec 5, 2024

• MagicTime

  Public
  MagicTime: Time-lapse Video Generation Models as Metamorphic Simulators

  time-lapsevideo-generationdiffusion-models+ 5text-to-videolong-video-generationtime-lapse-datasetopen-sora-planmetamorphic-video-generation

  Python

  •

  Apache License 2.0

  •125•1.3k•7•0•Updated Dec 5, 2024Dec 5, 2024

• WF-VAE

  Public
  Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Model

  Python

  •

  Apache License 2.0

  •6•100•4•0•Updated Dec 3, 2024Dec 3, 2024

• ChronoMagic-Bench

  Public
  [NeurIPS 2024 D&B Spotlight🔥] ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation

  benchmarkevaluationdataset+ 10time-lapseevaluation-kitvideo-generationdiffusion-modelstext-to-videoaigctime-lapse-dataset+ 3

  Python

  •

  Apache License 2.0

  •14•189•0•0•Updated Dec 3, 2024Dec 3, 2024

• MoE-LLaVA

  Public
  Mixture-of-Experts for Large Vision-Language Models

  moemulti-modalmixture-of-experts+ 1large-vision-language-model

  Python

  •

  Apache License 2.0

  •127•2k•61•1•Updated Dec 3, 2024Dec 3, 2024

• Video-LLaVA

  Public
  【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection

  multi-modalinstruction-tuninglarge-vision-language-model

  Python

  •

  Apache License 2.0

  •219•3.1k•110•6•Updated Dec 3, 2024Dec 3, 2024

• ProLLaMA

  Public
  A Protein Large Language Model for Multi-Task Protein Language Processing

  Python

  •

  Apache License 2.0

  •18•151•0•0•Updated Nov 28, 2024Nov 28, 2024

• LLaVA-o1

  Public
  1•47•2•0•Updated Nov 21, 2024Nov 21, 2024

• Chat-UniVi

  Public
  [CVPR 2024 Highlight🔥] Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

  video-understandingimage-understandinglarge-language-models+ 1vision-language-model

  Python

  •

  Apache License 2.0

  •44•903•17•0•Updated Oct 16, 2024Oct 16, 2024

• TaxDiff

  Public
  The official code for "TaxDiff: Taxonomic-Guided Diffusion Model for Protein Sequence Generation"

  protein-sequencesgenerate-modelmeachine-learning+ 1ai4science

  Python

  •

  MIT License

  •8•57•0•0•Updated Aug 23, 2024Aug 23, 2024

• Cycle3D

  Public
  [AAAI 2025🔥] Official implementation of Cycle3D: High-quality and Consistent Image-to-3D Generation via Generation-Reconstruction Cycle

  MIT License

  •7•191•2•0•Updated Aug 10, 2024Aug 10, 2024

• repaint123

  Public
  Official implementation of Repaint123: Fast and High-quality One Image to 3D Generation with Progressive Controllable 2D Repainting (ECCV 2024)

  MIT License

  •6•272•3•0•Updated Jul 26, 2024Jul 26, 2024

• Open-Sora-Dataset

  Public
  Python

  •6•98•4•1•Updated Jun 28, 2024Jun 28, 2024

• LLMBind

  Public
  LLMBind: A Unified Modality-Task Integration Framework

  Python

  •

  Apache License 2.0

  •1•17•1•0•Updated Jun 16, 2024Jun 16, 2024

• ChatLaw

  Public
  ChatLaw：A Powerful LLM Tailored for Chinese Legal. 中文法律大模型

  GNU Affero General Public License v3.0

  •550•7k•58•2•Updated Jun 4, 2024Jun 4, 2024

• EvaGaussians

  Public
  2•47•2•0•Updated Jun 3, 2024Jun 3, 2024

• Hallucination-Attack

  Public
  Attack to induce LLMs within hallucinations

  nlpai-safetyhallucinations+ 5llmllm-safetymachine-learningdeep-learningadversarial-attacks

  Python

  •

  MIT License

  •18•137•1•0•Updated May 17, 2024May 17, 2024

• Envision3D

  Public
  Envision3D: One Image to 3D with Anchor Views Interpolation

  Python

  •9•105•1•0•Updated May 16, 2024May 16, 2024

• LanguageBind

  Public
  【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment

  multi-modalzero-shotpretraining+ 1language-central

  Python

  •

  MIT License

  •53•761•31•1•Updated Mar 25, 2024Mar 25, 2024

• Peer-review-in-LLMs

  Public
  Peer-review-in-LLMs: Automatic Evaluation Method for LLMs in Open-environment，https://arxiv.org/pdf/2402.01830.pdf

  Python

  •2•32•0•0•Updated Feb 7, 2024Feb 7, 2024

• Machine-Mindset

  Public
  An MBTI Exploration of Large Language Models

  Python

  •

  Apache License 2.0

  •22•493•0•0•Updated Feb 2, 2024Feb 2, 2024

• Video-Bench

  Public
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!

  benchmarktoolkitlarge-language-models

  Python

  •2•122•7•0•Updated Dec 31, 2023Dec 31, 2023

• ChatExcel

  Public
  6•79•0•0•Updated Jun 30, 2023Jun 30, 2023