[BUG]: drizzle-zod's createInsertSchema() can't handle column of type `vector` #2424

sp88011 · 2024-06-02T23:22:33Z

What version of `drizzle-orm` are you using?

0.31.0

What version of `drizzle-kit` are you using?

0.22.1

Describe the Bug

One of my columns is of type vector (from the pgvector extension). I use createInsertSchema() from the drizzle-zod package to create a Zod schema for that table. When navigating to the page where that Zod schema is used, I'm getting the following error:

Error Cannot use 'in' operator to search for 'enumValues' in undefined

When I remove the vector column, everything works fine. I'm not really sure why the error talks about enumValues at all..but I figured it must have something to do with the vector column.

export const productSchema = createInsertSchema(T_product);
...

schema:

export const T_product = pgTable(
  "product",
  {
    id: varchar("id", { length: 36 })
      .$defaultFn(() => uuidv7())
      .primaryKey(),
    createdAt: timestamp("createdAt").defaultNow(),
    updatedAt: timestamp("updatedAt"),
    name: text("name").notNull(),
    embedding: vector("embedding", { dimensions: 384 }),
//...
  },
  (t) => ({
    embeddingIdx: index("embedding_idx").using(
      "hnsw",
      t.embedding.op("vector_cosine_ops"),
    ),
  }),
);

Expected behavior

Error should not happen.

Environment & setup

I'm using "drizzle-zod": "^0.5.1"

Full Error stack:

⨯ TypeError: Cannot use 'in' operator to search for 'enumValues' in undefined
    at eval (webpack-internal:///(rsc)/./node_modules/drizzle-zod/index.mjs:17:1262)
    at p (webpack-internal:///(rsc)/./node_modules/drizzle-zod/index.mjs:17:1319)
    at p (webpack-internal:///(rsc)/./node_modules/drizzle-zod/index.mjs:17:1789)
    at eval (webpack-internal:///(rsc)/./node_modules/drizzle-zod/index.mjs:17:564)
    at Array.map (<anonymous>)
    at c (webpack-internal:///(rsc)/./node_modules/drizzle-zod/index.mjs:17:547)
    at eval (webpack-internal:///(rsc)/./utils/zodSchemas.ts:65:88)
    at (rsc)/./utils/zodSchemas.ts (/Users/j/Documents/webdev/market-analytics/.next/server/app/admin/entities/page.js:1944:1)
    at __webpack_require__ (/Users/j/Documents/webdev/market-analytics/.next/server/webpack-runtime.js:33:43)
    at eval (webpack-internal:///(rsc)/./app/admin/entities/validations.ts:15:75)
    at (rsc)/./app/admin/entities/validations.ts (/Users/j/Documents/webdev/market-analytics/.next/server/app/admin/entities/page.js:1370:1)
    at __webpack_require__ (/Users/j/Documents/webdev/market-analytics/.next/server/webpack-runtime.js:33:43)
    at eval (webpack-internal:///(rsc)/./app/admin/entities/page.tsx:7:70)
    at (rsc)/./app/admin/entities/page.tsx (/Users/j/Documents/webdev/market-analytics/.next/server/app/admin/entities/page.js:1359:1)
    at Function.__webpack_require__ (/Users/j/Documents/webdev/market-analytics/.next/server/webpack-runtime.js:33:43)
    at async e9 (/Users/j/Documents/webdev/market-analytics/node_modules/next/dist/compiled/next-server/app-page.runtime.dev.js:35:396554)
    at async tb (/Users/j/Documents/webdev/market-analytics/node_modules/next/dist/compiled/next-server/app-page.runtime.dev.js:35:400212)
    at async tS (/Users/j/Documents/webdev/market-analytics/node_modules/next/dist/compiled/next-server/app-page.runtime.dev.js:35:400773)
    at async tS (/Users/j/Documents/webdev/market-analytics/node_modules/next/dist/compiled/next-server/app-page.runtime.dev.js:35:400904)
    at async tS (/Users/j/Documents/webdev/market-analytics/node_modules/next/dist/compiled/next-server/app-page.runtime.dev.js:35:400904)
    at async tS (/Users/j/Documents/webdev/market-analytics/node_modules/next/dist/compiled/next-server/app-page.runtime.dev.js:35:400904)
    at async tR (/Users/j/Documents/webdev/market-analytics/node_modules/next/dist/compiled/next-server/app-page.runtime.dev.js:36:2130)
    at async /Users/j/Documents/webdev/market-analytics/node_modules/next/dist/compiled/next-server/app-page.runtime.dev.js:36:2722 {
  digest: '3542844501',
  page: '/admin/products'
}```

The text was updated successfully, but these errors were encountered:

matthiasbayer · 2024-06-04T14:24:40Z

Experiencing the same error after updating to latest drizzle-orm 0.31.0.

The problems seems to be that the vector column is defined as type: array but doesn't expose a baseColumn value that is used by drizzle-zod here

jgontrum · 2024-06-06T14:34:25Z

Same here. Followed this official guide (https://orm.drizzle.team/learn/guides/vector-similarity-search) and using vector breaks my code when I'm using createInsertSchema on that table.

feliche93 · 2024-06-11T13:44:17Z

Can also confirm that I have the same issue 🤔 is there any quick fix around this except remove the column?

nicoalbanese · 2024-06-11T13:47:59Z

I experienced as well. As a temporary solution, I defined the zod schema manually for just my embedding table.

I have the content in one table, then when a new row gets added, it is broken into chunks and each chunk is saved in another table (embeddings) that has a FK to the id of the content.

mattiasbonte · 2024-06-13T17:26:58Z

FYI for those who are blocked because of this, I was able to avoid this issue by creating a new embeddings table and joining them onto my profiles. Which is probably a better way for our project in the long run.

waltershewmake · 2024-06-22T18:55:49Z

I think this may be happening with the point column type as well in postgres

diego-escobedo · 2024-06-26T19:06:14Z

Facing the same issue with both selectSchema and insertSchema with vector types specifically.

yantakus · 2024-06-28T05:27:17Z

I can confirm the same problem with point type. Is there any workaround? Or maybe a fix, which is better?

…ixes drizzle-team#2424)

dpromisel · 2024-07-08T15:42:50Z

Also facing this issue with vector columns when using createSelectSchema and createInsertSchema

ludersGabriel · 2024-07-09T14:52:24Z

I can also confirm that it is still happening with point type from drizzle's pg-core

danielivanovz · 2024-07-12T17:32:00Z

This is still happening for Point type

"drizzle-orm": "^0.32.0"
"drizzle-zod": "^0.5.1"

austinm911 · 2024-09-01T20:43:46Z

for now you can't co-locate the zod schemas in any files that export schemas. you will have to have the schemas in a separate file for now

timur-khakhalev · 2024-09-26T20:20:21Z

hi! any updates here? its still happen on
"drizzle-kit": "^0.24.2",
"drizzle-orm": "^0.33.0",
"drizzle-zod": "^0.5.1",

Matangub · 2024-10-03T15:24:41Z

I can confirm it happens for me as well on the latest drizzle zod version

Brenndoerfer · 2024-10-08T16:44:31Z

Downgrading to drizzle-zod@0.4.4 resolved it for me in the interim

npm i drizzle-zod@0.4.4

sp88011 added the bug Something isn't working label Jun 2, 2024

matthiasbayer mentioned this issue Jun 18, 2024

[BUG]: drizzle-typebox fails to map geometry column to type-box schema #2516

Open

Sukairo-02 added a commit to Sukairo-02/drizzle-orm that referenced this issue Jul 3, 2024

Added support for PG Geometry (fixes drizzle-team#2516), PG Vector (f…

8900997

…ixes drizzle-team#2424)

saevarb linked a pull request Aug 10, 2024 that will close this issue

[Pg] Add missing support for vector, point types to drizzle-zod #2780

Open

austinm911 mentioned this issue Sep 1, 2024

[BUG]: Drizzle Zod Error - drizzle-kit push TypeError Cannot use 'in' operator to search for 'enumValues' in undefined #2890

Closed

L-Mario564 added db/postgres drizzle/zod labels Oct 22, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[BUG]: drizzle-zod's createInsertSchema() can't handle column of type `vector` #2424

[BUG]: drizzle-zod's createInsertSchema() can't handle column of type `vector` #2424

sp88011 commented Jun 2, 2024

matthiasbayer commented Jun 4, 2024

jgontrum commented Jun 6, 2024

feliche93 commented Jun 11, 2024

nicoalbanese commented Jun 11, 2024

mattiasbonte commented Jun 13, 2024

waltershewmake commented Jun 22, 2024

diego-escobedo commented Jun 26, 2024

yantakus commented Jun 28, 2024

dpromisel commented Jul 8, 2024

ludersGabriel commented Jul 9, 2024

danielivanovz commented Jul 12, 2024

austinm911 commented Sep 1, 2024

timur-khakhalev commented Sep 26, 2024 •

edited

Loading

Matangub commented Oct 3, 2024 •

edited

Loading

Brenndoerfer commented Oct 8, 2024

[BUG]: drizzle-zod's createInsertSchema() can't handle column of type vector #2424

[BUG]: drizzle-zod's createInsertSchema() can't handle column of type vector #2424

Comments

sp88011 commented Jun 2, 2024

What version of drizzle-orm are you using?

What version of drizzle-kit are you using?

Describe the Bug

Expected behavior

Environment & setup

matthiasbayer commented Jun 4, 2024

jgontrum commented Jun 6, 2024

feliche93 commented Jun 11, 2024

nicoalbanese commented Jun 11, 2024

mattiasbonte commented Jun 13, 2024

waltershewmake commented Jun 22, 2024

diego-escobedo commented Jun 26, 2024

yantakus commented Jun 28, 2024

dpromisel commented Jul 8, 2024

ludersGabriel commented Jul 9, 2024

danielivanovz commented Jul 12, 2024

austinm911 commented Sep 1, 2024

timur-khakhalev commented Sep 26, 2024 • edited Loading

Matangub commented Oct 3, 2024 • edited Loading

Brenndoerfer commented Oct 8, 2024

[BUG]: drizzle-zod's createInsertSchema() can't handle column of type `vector` #2424

[BUG]: drizzle-zod's createInsertSchema() can't handle column of type `vector` #2424

What version of `drizzle-orm` are you using?

What version of `drizzle-kit` are you using?

timur-khakhalev commented Sep 26, 2024 •

edited

Loading

Matangub commented Oct 3, 2024 •

edited

Loading