Custom schema can't find entities

[Gokujo]

first of all my basics
db config -> calls with DbHandler::$connection

			$dbConfig = new Config\DatabaseConfig([
				'databases'   => [
					'default' => [
						'driver' => 'mysql',
						'prefix' => PREFIX . '_'
					],
					'user'    => [
						'driver' => 'mysql',
						'prefix' => USERPREFIX . '_'
					]
				],
				'connections' => [
					'mysql' => new Config\MySQLDriverConfig(
						connection : new Config\MySQL\TcpConnectionConfig(
							database : DBNAME,
							host : $host,
							port : $port,
							user : DBUSER,
							password : DBPASS,
						),
						reconnect : true,
						timezone : $config['date_adjust'],
						queryCache : true
					),
				],
			]);

Migrator

			$migratorConfig = new MigrationConfig([
				'directory' => DataManager::normalize_path(MH_ROOT . '/_migrations/'),
				'table'     => 'maharder_migrations',
				'safe'      => true
			]);

			$migrator = new Migrations\Migrator($migratorConfig, DbHandler::getConnection(), new Migrations\FileRepository($migratorConfig));

			$migrator->configure();

			$this->migrator = $migrator;

ORM

				$migrator         = new Migrator($model_paths);
				$registry         = new Registry(self::getConnection());
				$finder           = new Finder();
				$files            = $finder->files()->in($migrator->getModelPaths());
				$classLocator     = new ClassLocator($files);
				$embeddingLocator = new TokenizerEmbeddingLocator($classLocator);
				$entityLocator    = new TokenizerEntityLocator($classLocator);
				$compiler         = new Compiler();

				$schemaArray = $compiler->compile($registry, [
					new Schema\Generator\ResetTables(),
					new Annotated\Embeddings($embeddingLocator),
					new Annotated\Entities($entityLocator),
					new Annotated\TableInheritance(),
					new Annotated\MergeColumns(),
					new Schema\Generator\GenerateRelations(),
					new Schema\Generator\GenerateModifiers(),
					new Schema\Generator\ValidateEntities(),
					new Schema\Generator\RenderTables(),
					new Schema\Generator\RenderRelations(),
					new Schema\Generator\RenderModifiers(),
					new Schema\Generator\ForeignKeys(),
					new Annotated\MergeIndexes(),
					new Schema\Generator\SyncTables(),
					new Schema\Generator\GenerateTypecast(),
				]);

				$schema           = new Cycle\ORM\Schema($schemaArray);
				$factory          = new ORM\Factory(self::getConnection());
				$container        = new Container();
				$commandGenerator = new EventDrivenCommandGenerator($schema, $container);

				$orm = new ORM\ORM(
					factory : $factory,
					schema : $schema,
					commandGenerator : $commandGenerator
				);

				$generator = new Cycle\Schema\Generator\Migrations\GenerateMigrations($migrator->getMigrator()->getRepository(), $migrator->getMigrator()->getConfig());
				$generator->run($registry);
				$migrator->runMigration();
				$migrator->runMigration(true);
				
				return $orm;

Models path

$mh_models_paths = [
	MH_ROOT . '/_models/Admin',
	// Custom models //
];

my base model

<?php

use Cycle\Annotated\Annotation\Column;
use Cycle\Annotated\Annotation\Entity;
use Cycle\ORM\Entity\Behavior;

#[Entity]
#[Behavior\CreatedAt(
	field: 'createdAt',
	column: 'created_at'
)]
#[Behavior\UpdatedAt(
	field: 'updatedAt',
	column: 'updated_at'
)]
class BasisModel {
	#[Column(type: 'bigPrimary', primary: true, autoincrement: true)]
	protected int $id;

	#[Column(type: 'datetime')]
	protected \DateTimeImmutable $createdAt;

	#[Column(type: 'datetime', nullable: true)]
	protected ?\DateTimeImmutable $updatedAt = null;

	public function getId() : int {
		return $this->id;
	}

	public function getCreatedAt() : DateTimeImmutable {
		return $this->createdAt;
	}

	public function getUpdatedAt() : ?DateTimeImmutable {
		return $this->updatedAt;
	}

}

actual model in model path

<?php

use Cycle\Annotated\Annotation\Column;
use Cycle\Annotated\Annotation\Entity;

require_once(DLEPlugins::Check(ENGINE_DIR . '/inc/maharder/_includes/extras/paths.php'));

#[Entity(role : 'mhlog', repository : MhLogRepository::class, table : 'maharder_logs')]
class MhLog extends BasisModel {
	#[Column(type : 'string')]
	private string            $type;
	#[Column(type : 'string')]
	private string            $plugin;
	#[Column(type : 'string')]
	private string            $fn_name;
	#[Column(type : 'datetime')]
	private DateTimeImmutable $time;
	#[Column(type: 'text')]
	private string $message;

	public function getType() : string {
		return $this->type;
	}

	public function setType(string $type) : void {
		$this->type = $type;
	}

	public function getPlugin() : string {
		return $this->plugin;
	}

	public function setPlugin(string $plugin) : void {
		$this->plugin = $plugin;
	}

	public function getFnName() : string {
		return $this->fn_name;
	}

	public function setFnName(string $fn_name) : void {
		$this->fn_name = $fn_name;
	}

	public function getTime() : DateTimeImmutable {
		return $this->time;
	}

	public function setTime(DateTimeImmutable $time) : void {
		$this->time = $time;
	}

	public function getMessage() : string {
		return $this->message;
	}

	public function setMessage(string $message) : void {
		$this->message = $message;
	}

}

THe problem is that new Annotated\Entities($entityLocator) doesn't find the model MhLog. Maybe I got wrong the info from docs

[roxblnfk]

You don't need new Schema\Generator\SyncTables(), if you use migrations.
That generator (SyncTables) applies all the changes directly to DB

[Gokujo]

thx, but it doesn't change the fact, that models can't be found

[roxblnfk]

We will try to run your code. Meanwhile, please verify the correctness of the paths you've specified.
@msmakouz on it.

[Gokujo]

relative path of model MhLog engine/inc/maharder/_models/Admin/MhLog.php
relative path of model BasisModel engine/inc/maharder/_includes/database/BasisModel.php
relative path for migrations engine/inc/maharder/_migrations

MH_ROOT stands for engine/inc/maharder

complete classes in comments below

[Gokujo]

DbHandler

<?php

use Cycle\Annotated;
use Cycle\Annotated\Locator\TokenizerEmbeddingLocator;
use Cycle\Annotated\Locator\TokenizerEntityLocator;
use Cycle\Database\Config;
use Cycle\Database\DatabaseInterface;
use Cycle\Database\DatabaseManager;
use Cycle\ORM;
use Cycle\ORM\Entity\Behavior\EventDrivenCommandGenerator;
use Cycle\Schema;
use Cycle\Schema\Compiler;
use Cycle\Schema\Registry;
use Spiral\Tokenizer\ClassLocator;
use Symfony\Component\DependencyInjection\Container;
use Symfony\Component\Finder\Finder;

/**
 * Класс для работы с базой данных.
 *
 * @since 171.3.0
 */
abstract class DbHandler {
	/**
	 * Подключение к базе данных
	 *
	 * @var DatabaseManager|null
	 */
	private static ?DatabaseManager $connection = null;
	/**
	 * Объект подключения и управления баз данных.
	 * Необходимо само подключение к базе данных, чтобы получить ORM
	 *
	 * @var ORM\ORM|null
	 */
	private static ?ORM\ORM $manager = null;

	/**
	 * @param    bool    $user_db
	 *
	 * @return DatabaseInterface
	 */
	public static function getDb(bool $user_db = false) : DatabaseInterface {
		self::init();
		$db = $user_db ? 'user' : 'default';
		return self::$connection->database($db);
	}

	/**
	 * Инициирует подключение к базе данных
	 *
	 * @since 171.3.0
	 * @return void
	 */
	private static function init() : void {
		global $config;

		if (is_null(self::$connection)) {
			include_once(DLEPlugins::Check(ENGINE_DIR . '/data/dbconfig.php'));

			$db_name_port = explode(':', DBHOST);
			$port         = count($db_name_port) > 1 ? (int) $db_name_port[1] : 3306;
			$host         = $db_name_port[0];

			$dbConfig = new Config\DatabaseConfig([
				'databases'   => [
					'default' => [
						'driver' => 'mysql',
						'prefix' => PREFIX . '_'
					],
					'user'    => [
						'driver' => 'mysql',
						'prefix' => USERPREFIX . '_'
					]
				],
				'connections' => [
					'mysql' => new Config\MySQLDriverConfig(
						connection : new Config\MySQL\TcpConnectionConfig(
							database : DBNAME,
							host : $host,
							port : $port,
							user : DBUSER,
							password : DBPASS,
						),
						reconnect : true,
						timezone : $config['date_adjust'],
						queryCache : true
					),
				],
			]);

			self::setConnection($dbConfig);
		}

	}

	public static function getManager() : ORM\ORM {
		if (is_null(self::$manager)) self::setManager();
		return self::$manager;
	}

	public static function setManager(?ORM\ORM $manager = null, ?array $model_paths = []) : void {
		if (!is_null($manager)) self::$manager = $manager;
		else {
			if (is_null(self::$manager)) {

				$migrator         = new Migrator($model_paths);
				$registry         = new Registry(self::getConnection());
				$finder           = new Finder();
				$files            = $finder->files()->in($migrator->getModelPaths());
				$classLocator     = new ClassLocator($files);
				$embeddingLocator = new TokenizerEmbeddingLocator($classLocator);
				$entityLocator    = new TokenizerEntityLocator($classLocator);
				$compiler         = new Compiler();

				$schemaArray = $compiler->compile($registry, [
					new Schema\Generator\ResetTables(),
					new Annotated\Embeddings($embeddingLocator),
					new Annotated\Entities($entityLocator),
					new Annotated\TableInheritance(),
					new Annotated\MergeColumns(),
					new Schema\Generator\GenerateRelations(),
					new Schema\Generator\GenerateModifiers(),
					new Schema\Generator\ValidateEntities(),
					new Schema\Generator\RenderTables(),
					new Schema\Generator\RenderRelations(),
					new Schema\Generator\RenderModifiers(),
					new Schema\Generator\ForeignKeys(),
					new Annotated\MergeIndexes(),
					new Schema\Generator\GenerateTypecast(),
				]);

				$schema           = new Cycle\ORM\Schema($schemaArray);
				$factory          = new ORM\Factory(self::getConnection());
				$container        = new Container();
				$commandGenerator = new EventDrivenCommandGenerator($schema, $container);

				$orm = new ORM\ORM(
					factory : $factory,
					schema : $schema,
					commandGenerator : $commandGenerator
				);

				$generator = new Cycle\Schema\Generator\Migrations\GenerateMigrations($migrator->getMigrator()->getRepository(), $migrator->getMigrator()->getConfig());
				$generator->run($registry);
				$migrator->runMigration();
				$migrator->runMigration(true);

				self::$manager = $orm;
			}

		}
	}

	/**
	 * @return DatabaseManager|null
	 */
	public static function getConnection() : ?DatabaseManager {
		self::init();
		return self::$connection;
	}

	/**
	 * @param    Config\DatabaseConfig    $config
	 */
	public static function setConnection(Config\DatabaseConfig $config) : void {
		self::$connection = new DatabaseManager($config);
	}


}

[Gokujo]

Migrator

<?php

use Cycle\Migrations;
use Cycle\Migrations\Capsule;
use Cycle\Migrations\Config\MigrationConfig;

/**
 * Класс для работы с миграциями
 * Проверяет есть ли миграции для моделей базы данных
 * Если такие есть, то выполняет миграции
 *
 * Создаёт так-же соединение к базе данных
 *
 * @since 171.3.0
 *
 * */
class Migrator {
	/**
	 * Мигратор, который проверяет наличие новых миграций и выполняет их
	 *
	 * @var Migrations\Migrator|null
	 */
	private ?Migrations\Migrator $migrator = null;
	/**
	 * Массив путей к моделям
	 *
	 * @var array
	 */
	private array $model_paths = array();

	public function __construct(string|array|null $model_paths = null) {
		global $mh_models_paths;
		$this->setModelPaths($mh_models_paths);
		if (!is_null($model_paths)) $this->setModelPaths($model_paths);
	}

	public function getModelPaths() : array {
		return $this->model_paths ?? [];
	}



	/**
	 * Устанавливает пути к моделям
	 *
	 * @param    array|string    $model_paths    Путь к моделям
	 *
	 * @return void
	 */
	public function setModelPaths(array|string $model_paths) : void {
		if (is_array($model_paths)) {
			$this->model_paths = array_merge($model_paths, $this->model_paths);
		} else {
			$this->model_paths[] = $model_paths;
		}

		foreach ($this->model_paths as $id => $model_path) {
			$this->model_paths[$id] = DataManager::normalize_path($model_path);
		}
	}

	public function runMigration(bool $user_db = false) : void {
		$db = $user_db ? 'user' : 'default';
		$this->getMigrator()->run(new Capsule(DbHandler::getConnection()->database($db)));
	}

	/**
	 * Создаёт / проверят наличие новых миграций с базой данных.
	 * Миграции хранятся по установленному пути
	 *
	 * @since 171.3.0
	 * @return Migrations\Migrator
	 */
	public function getMigrator() : Migrations\Migrator {

		if (is_null($this->migrator)) {
			$migratorConfig = new MigrationConfig([
				'directory' => DataManager::normalize_path(MH_ROOT . '/_migrations/'),
				'table'     => 'maharder_migrations',
				'safe'      => true
			]);

			$migrator = new Migrations\Migrator($migratorConfig, DbHandler::getConnection(), new Migrations\FileRepository($migratorConfig));

			$migrator->configure();

			$this->migrator = $migrator;
		}

		return $this->migrator;
	}

}

[msmakouz]

@Gokujo Hi, I see that you're not using PSR-4-based class autoloading and instead manually include classes (I see code like this in some places: require_once(DLEPlugins::Check(ENGINE_DIR . '/inc/maharder/_includes/extras/paths.php'));). Have you included model classes somewhere? If you're not using class autoloading, you should have some entry point file where you include the composer class autoloader and all your class files, including models. Something like this:

// Register Composer's auto loader.
require __DIR__ . '/vendor/autoload.php';

// All project classes
require __DIR__ . '/engine/inc/maharder/_models/BasisModel.php';
require __DIR__ . '/engine/inc/maharder/_models/MhLog.php';
require __DIR__ . '/engine/inc/maharder/_repository/MhLogRepository.php';
require __DIR__ . '/engine/inc/maharder/DbHandler.php';
require __DIR__ . '/engine/inc/maharder/Migrator.php';

// Create ORM and other code
// ...

The paths you specified ($finder->files()->in($migrator->getModelPaths())) only tell the Tokenizer package where to look for your model classes. It doesn't use include or require for these classes. It is assumed that the classes are already included.

[Gokujo]

I have published the scripts below

[Gokujo]

DLE doesn't work with PSR-4. thats why only with require option

[Gokujo]

paths.php

<?php


if (!defined('DATALIFEENGINE')) {
	header('HTTP/1.1 403 Forbidden');
	header('Location: ../../../../../');

	exit('Hacking attempt!');
}

$current_dir = __DIR__;
if (preg_grep('/(cache)/', explode("\n", $current_dir))) $current_dir = dirname(__FILE__, 5);
else $current_dir = dirname(__FILE__, 6);

if (!defined('ROOT')) {
	define("ROOT", $current_dir);
}
if (!defined('MH_ROOT')) {
	define("MH_ROOT", ROOT . '/engine/inc/maharder');
}
if (!defined('MH_ADMIN')) {
	define("MH_ADMIN", MH_ROOT . '/admin');
}

$mh_models_paths = [
	MH_ROOT . '/_models/Admin',
	// Custom models //
];

$mh_loader_paths = [
	MH_ROOT . '/_includes/classes',
	MH_ROOT . '/_includes/classes/db',
	MH_ROOT . '/_includes/database',
	MH_ROOT . '/_includes/traits',
	MH_ROOT . '/_includes/twigExtensions',
	MH_ROOT . '/_models',
	// Custom paths //
];
$mh_loader_paths = array_merge($mh_loader_paths, $mh_models_paths);

include_once MH_ROOT . '/_includes/extras/functions.php';
include_once MH_ROOT . '/_includes/extras/mhLoader.php';
include_once MH_ROOT . '/_includes/vendor/autoload.php';

ComposerAction::destroy();

[Gokujo]

mhLoader.php

<?php

@ini_set('pcre.recursion_limit', 10000000);
@ini_set('pcre.backtrack_limit', 10000000);
@ini_set('pcre.jit', false);

spl_autoload_register(function ($class_name) {
	global $mh_loader_paths;

	$found = false;

	foreach ($mh_loader_paths as $path) {
		$dir_data = dirToArray($path);
		foreach ($dir_data as $data) {
			if ($class_name === str_replace('.php', '', $data)) {
				include_once DLEPlugins::Check("{$path}/{$data}");
				$found = true;
				break;
			}
		}
		if ($found) break;
	}

});

[msmakouz]

@Gokujo Could you create a public test repository with the files you mentioned that will reproduce your issue? It is preferable not to use DLE itself and its functions to reduce the code. But it should reproduce your issue.

[Gokujo]

Could you create a public test repository

https://github.com/Gokujo/cycledemo

[msmakouz]

@Gokujo Hi, I found several issues with your code, but I didn't find any problems with the Cycle packages.
I had an issue with file include paths. I made the following changes to the code.

In the index file, I added the inclusion of your models, as I got an error saying that the class does not exist:

require_once __DIR__ . '/data/variables.php';
require_once INCLUDES_DIR . '/vendor/autoload.php';
require_once DATA_DIR . '/functions.php';
require_once INCLUDES_DIR . '/abstract/BasisModel.php';
require_once INCLUDES_DIR . '/model/MhLog.php';

$mh_logs = new MhDB(MhLog::class);

I commented out the Annotated\TableInheritance generator and removed the #[Entity] attribute from BasisModel for testing purposes. Since you inherit the MhLog class from BasisModel, you should use one of the inheritance mechanisms, but none of them are defined in your case. Docs: JTI https://cycle-orm.dev/docs/advanced-joined-table-inheritance/current/en, STI https://cycle-orm.dev/docs/advanced-single-table-inheritance/current/en

Also, BasisModel will not be found because the class is located in the abstract folder, while the path to the model is specified only in the model folder here: https://github.com/Gokujo/cycledemo/blob/main/data/variables.php#L17

And your folder is named abstract, but the path is specified for abstracts here: https://github.com/Gokujo/cycledemo/blob/main/data/variables.php#L10

I also had an issue where the normalize_path function returns the path without the initial slash here, and it throws an error that such a directory does not exist. But this might be relevant only for macOS: https://github.com/Gokujo/cycledemo/blob/main/includes/static/DataManager.php#L271

After all these changes, I got the required class in the schema. The result is attached.

You can more easily catch errors related to class inclusion if, in the file vendor/spiral/tokenizer/src/AbstractLocator.php, you comment out everything except return new \ReflectionClass($class); in the protected function classReflection(string $class) function. The code in this method handles and logs errors related to class inclusion, but if you don't have a logger configured, you won't see them.

[Gokujo]

I just removed #[Entity] from my working project and got another type of issue. Sorry for the misspelled paths and names.

I have updated demo repo because now I have an issue with behaviors
Fatal error: Uncaught PDOException: SQLSTATE[HY000]: General error: 1364 Field 'created_at' doesn't have a default value in https://github.com/Gokujo/cycledemo/blob/06be835270582f66516134d7c5378955b9f14b3c/includes/abstract/BasisModel.php#L9

i tried to register this class as readonly entity and use STI but I need this class only as extendable class and not as table