{{ message }}
Repository navigation
Tensor::normalize() doesn't normilize #110
Description
System Info
linux ubuntu 24.04 , using larvel
PHP Version
8.5
Environment/Platform
- Command-line application
- Web application
- Serverless
- Other (please specify)
Description
[0] to flatten the array, the output should be normalized to 1 during the unit test below, but its not
use function Codewithkyrian\Transformers\Pipelines\pipeline;
public function vectorize(string $text): array
{
return $this->extractor()($text, normalize: true, pooling: 'mean')[0];
}
Reproduction
run this unit test after implementing the vecotrize function in a class
public function test_vector_is_normalized(): void
{
$vector = self::$vectorizer->vectorize('normal unit test');
$norm = sqrt(array_sum(array_map(fn ($x) => $x ** 2, $vector)));
$this->assertEqualsWithDelta(1.0, $norm, 0.001);
}
Activity