Skip to content

Commit

Permalink
[llava][11/N] Migrate sampler to extension/llm
Browse files Browse the repository at this point in the history
Summary: Move sampler code to extension/llm so that it can be reused by
llava runner.

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
  • Loading branch information
larryliu0820 committed Jul 30, 2024
1 parent 1e14333 commit 7b2ba62
Show file tree
Hide file tree
Showing 9 changed files with 3 additions and 3 deletions.
2 changes: 1 addition & 1 deletion examples/models/llama2/runner/runner.h
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
#include <string>
#include <unordered_map>

#include <executorch/examples/models/llama2/sampler/sampler.h>
#include <executorch/extension/llm/sampler/sampler.h>
#include <executorch/extension/llm/tokenizer/tokenizer.h>
#include <executorch/extension/module/module.h>
#include <executorch/extension/runner_util/managed_tensor.h>
Expand Down
2 changes: 1 addition & 1 deletion examples/models/llama2/runner/targets.bzl
Original file line number Diff line number Diff line change
Expand Up @@ -33,7 +33,7 @@ def define_common_targets():
],
exported_deps = [
"//executorch/backends/xnnpack:xnnpack_backend",
"//executorch/examples/models/llama2/sampler:sampler" + aten_suffix,
"//executorch/extension/llm/sampler:sampler" + aten_suffix,
"//executorch/extension/evalue_util:print_evalue" + aten_suffix,
"//executorch/extension/runner_util:managed_tensor" + aten_suffix,
"//executorch/extension/module:module" + aten_suffix,
Expand Down
File renamed without changes.
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@
* SOFTWARE.
*/

#include <executorch/examples/models/llama2/sampler/sampler.h>
#include <executorch/extension/llm/sampler/sampler.h>

namespace torch {
namespace executor {
Expand Down
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.

0 comments on commit 7b2ba62

Please sign in to comment.