Skip to content

tc39/proposal-import-bytes

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

14 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Import Bytes

Champions: @styfle

Author(s): @styfle, Guy Bedford

Status: Stage 2.

Please leave any feedback in the issues, thanks!

Synopsis

This proposal is buit on top of import attributes and immutable arraybuffer to add the ability to import arbitrary bytes in a common way across JavaScript environments.

Developers will then be able to import the bytes as follows:

import bytes from "./photo.png" with { type: "bytes" };
import("./photo.png", { with: { type: "bytes" } });

The bytes are returned as a Uint8Array backed by an immutable arraybuffer.

Note: a similar proposal was mentioned in whatwg/html#9444

Motivation

In a similar manner to why JSON modules are useful, importing raw bytes is useful to extend this behavior to all files. This proposal provides an isomorphic way to read a file, regardless of the JavaScript environment.

For example, a developer may want to read a .png file to process an image or .woff to process a font and pass the bytes into isomorphic tools like satori.

Today, the developer must detect the platform in order to read the bytes.

async function getBytes(path) {
  if (typeof Deno !== "undefined") {
    const bytes = await Deno.readFile(path);
    return bytes;
  }
  if (typeof Bun !== "undefined") {
    const bytes = await Bun.file(path).bytes();
    return bytes;
  }
  if (typeof require !== "undefined") {
    const fs = require("fs/promises");
    const bytes = await fs.readFile(path);
    return bytes;
  }
  if (typeof window !== "undefined") {
    const response = await fetch(path);
    const bytes = await response.bytes();
    return bytes;
  }
  throw new Error("Unsupported runtime");
}

const bytes = await getBytes("./photo.png");

We can maximize portability and reduce boilerplate by turning this into a single line of code:

import bytes from "./photo.png" with { type: "bytes" };

Using an import also provides opportunity for further optimizations when using a bundler. For example, bundlers can statically analyze this import and inline as base64.

const bytes = Uint8Array.fromBase64("iVBORw0KGgoAAAANSUhEUgAAAAEAAAABCAQAAAC1HAwCAAAAC0lEQVR42mNkqAcAAIUAgUW0RjgAAAAASUVORK5CYII=")

Proposed semantics and interoperability

If a module import has an attribute with key type and value bytes, the host is required to either fail the import, or treat it as a Uint8Array backed by an immutable ArrayBuffer. The Uint8Array object is the default export of the module (which has no named exports).

In browser environments, this will be equivalent to fetch() such that sec-fetch-dest will be empty. The response content-type will be ignored.

In "local" desktop/server/embedded, this will be equivalent to a file read. The file extension will be ignored.

All of the import statements in the module graph that address the same module will evaluate to the same Uint8Array object.

FAQ

How would this proposal work with caching?

The determination of whether the type attribute is part of the module cache key is left up to hosts (as it is for all import attributes).

For example, import "foo" and import "foo" with { type: "bytes" } may return the same module in one host, and different modules with another host. Both are valid implementations.

However, a dynamic import and a static import with the same type must return the same module, regardless of host.

See discussion in Issue #4

Is there any prior art?

Deno 2.4 added support in July 2025 to inline a Uint8Array

import imageBytes from "./image.png" with { type: "bytes" };

Bun 1.1.7 added a similar feature in May 2024 to inline a string of text

import html from "./index.html" with { type: "text" };

webpack added asset modules to inline a base64 data URI via url-loader in 4.x and now asset/inline in 5.x

import logo from "./images/logo.svg"

esbuild added a binary loader to inline a Uint8Array

import uint8array from "./example.data"

Parcel added a data url scheme to inline a base64 data URI

import background from "data-url:./background.png";

Moddable added a Resource class to inline a host buffer for embedded systems

let resource = new Resource("logo.bmp");

Why not mutable?

Mutable can be problematic for several reasons:

  • may need multiple copies of the buffer in memory to avoid different underlying bytes for import(specifier, { type: "json" }) and import(specifier, { type: "bytes" })
  • may cause unexpected behavior when multiple modules import the same buffer and detach (say postMessage() or transferToImmutable()) in one module which would cause it to become detached in the other module too
  • may cause excessive RAM usage for embedded system (immutable could use ROM instead)
  • may cause excessive memory when tracking source maps
  • may cause an undeniable global communication channel

See discussion in Issue #2 and #5

Why Uint8Array?

Uint8Array is compatible with Node.js Buffer which makes it widely compatible with existing JavaScript code.

Why not ArrayBuffer?

ArrayBuffers cannot be read from directly; the developer must create a view, such as a Uint8Array, to read data. Providing a Uint8Array avoids that additional effort.

This pattern is defined in the W3C design principals.

There was some discussion to switch to ArrayBuffer in Issue #5 however the plenary meeting reached concensus that Uint8Array is more desireable and the problems described in that issue can still be solved with Uint8Array, as long as it's backed by an Immutable ArrayBuffer.

Why not Blob?

Blob is part of the W3C File API, not part of JavaScript, so it is not a viable solution to include in a TC39 Proposal. Furthermore, Blob typically includes a MIME Type but this proposal ignores the type.

Why not ReableStream?

ReadableStream is part of the WHATWG Streams, not part of JavaScript, so it is not a viable solution to include in a TC39 Proposal. Furthermore, there is no helper method to turn a stream into a buffer so this won't solve the original motivation of writing isomorphic JavaScript.

See discussion in Issue #3

Why type: bytes?

The bytes() method is familiar to those using Response.bytes() or newer Blob.bytes() which both return Uint8Array.

About

A modest proposal for importing bytes in javascript

Resources

License

Code of conduct

Security policy

Stars

Watchers

Forks