You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
* fix: changes following issue 4593
Signed-off-by: Theodor Mihalache <tmihalac@redhat.com>
* fix: changes following issue 4593
- Reverted Fixed file path in templates to be relative path
Signed-off-by: Theodor Mihalache <tmihalac@redhat.com>
* docs: updated following review
Signed-off-by: Theodor Mihalache <tmihalac@redhat.com>
* Updated documents following review suggestions
Added symlinks in all the templates pointing to the local template with the .gitignore file
Signed-off-by: Theodor Mihalache <tmihalac@redhat.com>
---------
Signed-off-by: Theodor Mihalache <tmihalac@redhat.com>
Copy file name to clipboardexpand all lines: docs/getting-started/concepts/feature-view.md
+1-1
Original file line number
Diff line number
Diff line change
@@ -14,7 +14,7 @@ Feature views consist of:
14
14
* zero or more [entities](entity.md)
15
15
* If the features are not related to a specific object, the feature view might not have entities; see [feature views without entities](feature-view.md#feature-views-without-entities) below.
16
16
* a name to uniquely identify this feature view in the project.
17
-
* (optional, but recommended) a schema specifying one or more [features](feature-view.md#feature) (without this, Feast will infer the schema by reading from the data source)
17
+
* (optional, but recommended) a schema specifying one or more [features](feature-view.md#field) (without this, Feast will infer the schema by reading from the data source)
18
18
* (optional, but recommended) metadata (for example, description, or other free-form metadata via `tags`)
19
19
* (optional) a TTL, which limits how far back Feast will look when generating historical datasets
Copy file name to clipboardexpand all lines: docs/getting-started/concepts/overview.md
+1-4
Original file line number
Diff line number
Diff line change
@@ -3,10 +3,7 @@
3
3
### Feast project structure
4
4
5
5
The top-level namespace within Feast is a **project**. Users define one or more [feature views](feature-view.md) within a project. Each feature view contains one or more [features](feature-view.md#feature). These features typically relate to one or more [entities](entity.md). A feature view must always have a [data source](data-ingestion.md), which in turn is used during the generation of training [datasets](feature-retrieval.md#dataset) and when materializing feature values into the online store.
6
-
7
-
.png>)
8
-
9
-
**Projects** provide complete isolation of feature stores at the infrastructure level. This is accomplished through resource namespacing, e.g., prefixing table names with the associated project. Each project should be considered a completely separate universe of entities and features. It is not possible to retrieve features from multiple projects in a single request. We recommend having a single feature store and a single project per environment (`dev`, `staging`, `prod`).
6
+
You can read more about Feast projects in the [project page](project.md).
Projects provide complete isolation of feature stores at the infrastructure level. This is accomplished through resource namespacing, e.g., prefixing table names with the associated project. Each project should be considered a completely separate universe of entities and features. It is not possible to retrieve features from multiple projects in a single request. We recommend having a single feature store and a single project per environment (`dev`, `staging`, `prod`).
4
+
5
+
.png>)
6
+
7
+
Users define one or more [feature views](feature-view.md) within a project. Each feature view contains one or more [features](feature-view.md#field). These features typically relate to one or more [entities](entity.md). A feature view must always have a [data source](data-ingestion.md), which in turn is used during the generation of training [datasets](feature-retrieval.md#dataset) and when materializing feature values into the online store.
8
+
9
+
The concept of a "project" provide the following benefits:
10
+
11
+
**Logical Grouping**: Projects group related features together, making it easier to manage and track them.
12
+
13
+
**Feature Definitions**: Within a project, you can define features, including their metadata, types, and sources. This helps standardize how features are created and consumed.
14
+
15
+
**Isolation**: Projects provide a way to isolate different environments, such as development, testing, and production, ensuring that changes in one project do not affect others.
16
+
17
+
**Collaboration**: By organizing features within projects, teams can collaborate more effectively, with clear boundaries around the features they are responsible for.
18
+
19
+
**Access Control**: Projects can implement permissions, allowing different users or teams to access only the features relevant to their work.
Copy file name to clipboardexpand all lines: docs/getting-started/quickstart.md
+34-9
Original file line number
Diff line number
Diff line change
@@ -1,6 +1,29 @@
1
1
# Quickstart
2
2
3
-
In this tutorial we will
3
+
## What is Feast?
4
+
5
+
Feast (Feature Store) is an open-source feature store designed to facilitate the management and serving of machine learning features in a way that supports both batch and real-time applications.
6
+
7
+
**For Data Scientists*: Feast is a a tool where you can easily define, store, and retrieve your features for both model development and model deployment. By using Feast, you can focus on what you do best: build features that power your AI/ML models and maximize the value of your data.
8
+
9
+
**For MLOps Engineers*: Feast is a library that allows you to connect your existing infrastructure (e.g., online database, application server, microservice, analytical database, and orchestration tooling) that enables your Data Scientists to ship features for their models to production using a friendly SDK without having to be concerned with software engineering challenges that occur from serving real-time production systems. By using Feast, you can focus on maintaining a resilient system, instead of implementing features for Data Scientists.
10
+
11
+
**For Data Engineers*: Feast provides a centralized catalog for storing feature definitions allowing one to maintain a single source of truth for feature data. It provides the abstraction for reading and writing to many different types of offline and online data stores. Using either the provided python SDK or the feature server service, users can write data to the online and/or offline stores and then read that data out again in either low-latency online scenarios for model inference, or in batch scenarios for model training.
12
+
13
+
For more info refer to [Introduction to feast](../README.md)
14
+
15
+
## Prerequisites
16
+
* Ensure that you have Python (3.9 or above) installed.
17
+
* It is recommended to create and work in a virtual environment:
18
+
```sh
19
+
# create & activate a virtual environment
20
+
python -m venv venv/
21
+
source venv/bin/activate
22
+
```
23
+
24
+
## Overview
25
+
26
+
In this tutorial we will:
4
27
5
28
1. Deploy a local feature store with a **Parquet file offline store** and **Sqlite online store**.
6
29
2. Build a training dataset using our time series features from our **Parquet files**.
@@ -9,7 +32,9 @@ In this tutorial we will
9
32
5. Read the latest features from the online store for real-time inference.
10
33
6. Explore the (experimental) Feast UI
11
34
12
-
## Overview
35
+
***Note*** - Feast provides a python SDK as well as an optional [hosted service](../reference/feature-servers/python-feature-server.md) for reading and writing feature data to the online and offline data stores. The latter might be useful when non-python languages are required.
36
+
37
+
For this tutorial, we will be using the python SDK.
13
38
14
39
In this tutorial, we'll use Feast to generate training data and power online model inference for a
15
40
ride-sharing driver satisfaction prediction model. Feast solves several common issues in this flow:
@@ -279,7 +304,7 @@ There's an included `test_workflow.py` file which runs through a full sample wor
279
304
7. Verify online features are updated / fresher
280
305
281
306
We'll walk through some snippets of code below and explain
282
-
### Step 3a: Register feature definitions and deploy your feature store
307
+
### Step 4: Register feature definitions and deploy your feature store
283
308
284
309
The `apply` command scans python files in the current directory for feature view/entity definitions, registers the
285
310
objects, and deploys infrastructure. In this example, it reads `example_repo.py` and sets up SQLite online store tables. Note that we had specified SQLite as the default online store by
@@ -311,7 +336,7 @@ Created sqlite table my_project_driver_hourly_stats
311
336
{% endtab %}
312
337
{% endtabs %}
313
338
314
-
### Step 3b: Generating training data or powering batch scoring models
339
+
### Step 5: Generating training data or powering batch scoring models
315
340
316
341
To train a model, we need features and labels. Often, this label data is stored separately (e.g. you have one table storing user survey results and another set of tables with feature values). Feast can help generate the features that map to these labels.
317
342
@@ -466,7 +491,7 @@ print(training_df.head())
466
491
```
467
492
{% endtab %}
468
493
{% endtabs %}
469
-
### Step 3c: Ingest batch features into your online store
494
+
### Step 6: Ingest batch features into your online store
470
495
471
496
We now serialize the latest values of features since the beginning of time to prepare for serving (note:
472
497
`materialize-incremental` serializes all new features since the last `materialize` call).
@@ -499,7 +524,7 @@ Materializing 2 feature views to 2024-04-19 10:59:58-04:00 into the sqlite onlin
499
524
{% endtab %}
500
525
{% endtabs %}
501
526
502
-
### Step 3d: Fetching feature vectors for inference
527
+
### Step 7: Fetching feature vectors for inference
503
528
504
529
At inference time, we need to quickly read the latest feature values for different drivers (which otherwise might
505
530
have existed only in batch sources) from the online feature store using `get_online_features()`. These feature
@@ -544,7 +569,7 @@ pprint(feature_vector)
544
569
{% endtab %}
545
570
{% endtabs %}
546
571
547
-
### Step 3e: Using a feature service to fetch online features instead.
572
+
### Step 8: Using a feature service to fetch online features instead.
548
573
549
574
You can also use feature services to manage multiple features, and decouple feature view definitions and the
550
575
features needed by end applications. The feature store can also be used to fetch either online or historical
@@ -594,7 +619,7 @@ pprint(feature_vector)
594
619
{% endtab %}
595
620
{% endtabs %}
596
621
597
-
## Step 4: Browse your features with the Web UI (experimental)
622
+
## Step 9: Browse your features with the Web UI (experimental)
598
623
599
624
View all registered features, data sources, entities, and feature services with the Web UI.
600
625
@@ -626,7 +651,7 @@ INFO: Uvicorn running on http://0.0.0.0:8888 (Press CTRL+C to quit)
626
651
627
652

628
653
629
-
## Step 5: Re-examine `test_workflow.py`
654
+
## Step 10: Re-examine `test_workflow.py`
630
655
Take a look at `test_workflow.py` again. It showcases many sample flows on how to interact with Feast. You'll see these
631
656
show up in the upcoming concepts + architecture + tutorial pages as well.
0 commit comments