Feat builder

.claude/plans/PLAN-sql-tokenizer-ast.md

@@ -0,0 +1,95 @@
+# Implementation Plan: SQL Tokenizer & AST
+
+**Status:** Complete
+**Created:** 2026-03-24
+**Completed:** 2026-03-24
+**Description:** Add a tokenizer, parser, AST node hierarchy, serializer, visitor pattern, and Builder integration for SQL SELECT queries. Supports per-dialect tokenization/serialization for MySQL, PostgreSQL, ClickHouse, SQLite, and MariaDB. Enables round-trip: SQL string -> tokens -> AST -> modify/validate -> SQL string, plus AST <-> Builder conversion.
+
+## Phases
+
+### Phase 1: Token Types & Base Tokenizer
+- **Status:** [x] Complete
+
+### Phase 2: AST Node Hierarchy
+- **Status:** [x] Complete
+
+### Phase 3: Base SQL Parser (Tokens -> AST)
+- **Status:** [x] Complete
+
+### Phase 4: Base SQL Serializer (AST -> SQL)
+- **Status:** [x] Complete
+
+### Phase 5: Dialect-Specific Tokenizers & Serializers
+- **Status:** [x] Complete
+
+### Phase 6: Visitor Pattern for AST Modification & Validation
+- **Status:** [x] Complete
+
+### Phase 7: Builder <-> AST Integration
+- **Status:** [x] Complete
+
+## Progress Log
+
+### Phase 1 - f871339
+- **Tests added:** 42 (35 initial + 7 review fixes)
+- **Files:** TokenType.php, Token.php, Tokenizer.php, TokenizerTest.php
+- **Review issues fixed:** C1 (block comment bug), C2 (unknown chars), W1 (backslash escapes), W2 (scientific notation), W3 (quoted identifier escapes), W5 (aggregate function casing), W6 (keyword map constant)
+
+### Phase 2 - f871339
+- **Tests added:** 27
+- **Files:** Expr.php, 22 AST node classes, SelectStatement.php, NodeTest.php
+
+### Phase 3 - 4e0f32d
+- **Tests added:** 52
+- **Files:** Parser.php, ParserTest.php
+- **Review issues fixed:** C1 (FILTER clause stored), C2 (:: cast in parseUnary), C3 (Star schema), C4 (inColumnList reset)
+
+### Phase 4 - b3243cf
+- **Tests added:** 62
+- **Files:** Serializer.php, SerializerTest.php
+
+### Phase 5 - 5f5ae07
+- **Tests added:** 16
+- **Files:** 5 tokenizer subclasses, 5 serializer subclasses, 6 test files
+
+### Phase 6 - 36641e3
+- **Tests added:** 17
+- **Files:** Visitor.php, Walker.php, TableRenamer.php, ColumnValidator.php, FilterInjector.php, VisitorTest.php
+
+### Phase 7 - 188da99
+- **Tests added:** 40
+- **Files:** Builder.php (modified), BuilderIntegrationTest.php
+
+### Lint/Static Analysis - 4d19662
+- **Files changed:** 43 (formatting + type fixes)
+
+## Final Summary
+
+### Tests Added
+- 256 new tests total
+- 42 tokenizer tests
+- 27 AST node tests
+- 52 parser tests
+- 62 serializer tests
+- 16 dialect tokenizer/serializer tests
+- 17 visitor tests
+- 40 builder integration tests
+
+### Files Changed
+- 55 files created, 3 files modified
+
+### Commits
+- f871339 - Token types, tokenizer, AST nodes
+- 4e0f32d - Recursive-descent parser
+- b3243cf - Serializer + parser review fixes
+- 5f5ae07 - Dialect tokenizers/serializers
+- 36641e3 - Visitor pattern
+- 188da99 - Builder <-> AST integration
+- 4d19662 - Lint and static analysis fixes
+
+### Verification
+- [x] All 4045 tests pass
+- [x] Lint passes (Pint)
+- [x] Static analysis passes (PHPStan level max)
+- [x] No TODOs remaining
+- [x] Plan file complete

.github/workflows/integration.yml

@@ -0,0 +1,75 @@
+name: Integration Tests
+
+on:
+  push:
+    branches: [main]
+  pull_request:
+
+jobs:
+  integration:
+    runs-on: ubuntu-latest
+
+    services:
+      mysql:
+        image: mysql:8.4
+        ports:
+          - 13306:3306
+        env:
+          MYSQL_ROOT_PASSWORD: test
+          MYSQL_DATABASE: query_test
+        options: >-
+          --health-cmd="mysqladmin ping -h localhost"
+          --health-interval=10s
+          --health-timeout=5s
+          --health-retries=5
+
+      postgres:
+        image: postgres:16
+        ports:
+          - 15432:5432
+        env:
+          POSTGRES_PASSWORD: test
+          POSTGRES_DB: query_test
+        options: >-
+          --health-cmd="pg_isready"
+          --health-interval=10s
+          --health-timeout=5s
+          --health-retries=5
+
+      clickhouse:
+        image: clickhouse/clickhouse-server:24
+        ports:
+          - 18123:8123
+          - 19000:9000
+        env:
+          CLICKHOUSE_DB: query_test
+        options: >-
+          --health-cmd="wget --spider -q http://localhost:8123/ping"
+          --health-interval=10s
+          --health-timeout=5s
+          --health-retries=5
+
+      mongodb:
+        image: mongo:7
+        ports:
+          - 27017:27017
+        options: >-
+          --health-cmd="mongosh --eval 'db.runCommand({ping:1})'"
+          --health-interval=10s
+          --health-timeout=5s
+          --health-retries=5
+
+    steps:
+      - uses: actions/checkout@v4
+
+      - name: Setup PHP
+        uses: shivammathur/setup-php@v2
+        with:
+          php-version: '8.4'
+          extensions: pdo, pdo_mysql, pdo_pgsql, mongodb
+
+      - name: Install dependencies
+        run: composer install --no-interaction --prefer-dist
+
+      - name: Run integration tests
+        run: composer test:integration

.gitignore

@@ -1,3 +1,7 @@
 .phpunit.result.cache
 composer.phar
 /vendor/
+.idea
+coverage
+coverage.xml
+.DS_Store

CLAUDE.md

@@ -0,0 +1,4 @@
+# Project Rules
+
+- Never add decorative section-style comment headers (e.g. `// ==================`, `// ----------`, `// ~~~~` or similar). Use plain single-line comments only when necessary.
+- Always use imports (`use` statements) instead of fully qualified class names in test files and source code.