v0.0.38

What's Changed

• I/O: Updated to ingestr>=0.13.61
• CFR: Improved log output
• CFR: Fixed double quoting of table name. Thanks, @karynzv.
• CFR: When importing, started using replace strategy instead of append
• CFR: Improved importing data re. type mapping without NumPy
• CFR: Truncated target table before importing, using append
  strategy again, because replace doesn't do the right DDL.
• I/O: Tuned down ingestr, it masked native I/O adapters

Details

• I/O: Improve documentation page about ingestr by @amotl in #476
• Dependencies and documentation by @amotl in #478
• Chore: Fix mypy type checking by downgrading types-docutils by @amotl in #484
• CFR: Assorted fixes and improvements by @amotl in #483
• Update botocore requirement from <1.39 to <1.40 by @dependabot[bot] in #480
• Update dlt requirement from <1.13,>=1.10 to >=1.10,<1.14 by @dependabot[bot] in #485
• Update datasets requirement from <4 to <5 by @dependabot[bot] in #486
• Update fastapi requirement from <0.116 to <0.117 by @dependabot[bot] in #488
• Update mypy requirement from <1.17 to <1.18 by @dependabot[bot] in #489
• Update pyarrow requirement from <20.1 to <21.1 by @dependabot[bot] in #490
• Update testcontainers requirement from <4.11 to <4.13 by @dependabot[bot] in #492
• Update polars requirement from <1.32 to <1.33 by @dependabot[bot] in #497
• Update aiobotocore requirement from <2.24 to <2.25 by @dependabot[bot] in #495
• Dependencies (PyMongo): Fix error with NumPy 2.x by @amotl in #501
• Chore: Remove Python 3.10 from compatibility support for Kinesis nozzle by @amotl in #502
• Bump astral-sh/setup-uv from 5 to 6 by @dependabot[bot] in #493
• Chore: Fix boot-time warning about ingestr by @amotl in #500
• I/O: Tune down ingestr, it masked native I/O adapters by @amotl in #503
• CI: Separate GHA workflow definition for Kinesis by @amotl in #504

Full Changelog: v0.0.37...v0.0.38

v0.0.37

What's Changed

• Settings: Fixed comparison of 0s vs 0ms. Thanks, @hlcianfagna.
• DMS: Provided a recipe file to relay primary key and column type map information
• DMS: Provided a recipe option to ignore processing DMS control DDL events
• DMS: Started using the "direct" column mapping by default,
  retaining the "universal" column mapping optionally.
• Dependencies: Updated to commons-codec>=0.0.23
• I/O: Adapter for PostgreSQL full-load using ingestr
• I/O: Added documentation about ingestr adapter

Details

• Fix comparison of 0s vs 0ms by @hlcianfagna in #458
• Update uvicorn requirement from <0.35 to <0.36 by @dependabot in #471
• Update marimo requirement from <0.14 to <0.15 by @dependabot in #472
• DMS: Accept a recipe file to receive settings and parameters by @amotl in #469
• Bump astral-sh/setup-uv from 5 to 6 by @dependabot in #474
• Dependencies: Update to async-kinesis>=2 by @amotl in #473
• I/O: Adapter for PostgreSQL by @amotl in #445
• I/O: Add documentation about ingestr adapter by @amotl in #463

New Contributors

• @hlcianfagna made their first contribution in #458

Full Changelog: v0.0.36...v0.0.37

v0.0.36

What's Changed

• Dependencies: Migrated from zyp to tikray. It's effectively the
  same, but provided using a dedicated package now
• Dependencies: Updated to croud-1.14
• Dependencies: Updated to async-kinesis-2.0.0. Thanks, @hampsterx.
• CDC: Added canonical SQL example for PostgreSQL from Ibis
• CDC: Enabled loading DMS events from Kinesis streams and stream-dump files
• CDC: Added subcommand ctk dms table-mappings
• Dependencies: Updated to commons-codec>=0.0.23

Details

• Link to Google's MCP Toolbox for Databases by @kneth in #438
• Documentation: cratedb-mcp has been released by @amotl in #439
• Update mypy requirement from <1.16 to <1.17 by @dependabot in #441
• Update cattrs requirement from <25 to <26 by @dependabot in #442
• Update aiobotocore requirement from <2.23 to <2.24 by @dependabot in #453
• Update duckdb requirement from <1.3 to <1.4 by @dependabot in #447
• CI: Maintenance for DynamoDB/LocalStack integration testing and more by @amotl in #454
• Bump cratedb-sqlparse from 0.0.13 to 0.0.15 by @dependabot in #452
• Dependencies: Migrate from zyp to tikray by @amotl in #456
• Dependencies: Update to croud-1.14 by @amotl in #459
• Dependencies: Update to async-kinesis-2.0.0 by @amotl in #460
• Testing: Improve package dependencies for testcontainers ensemble by @amotl in #462
• CI: Use the uv package manager. It is fast. by @amotl in #461
• CDC: Add canonical SQL example for PostgreSQL from Ibis by @amotl in #457
• Update polars requirement from <1.30 to <1.32 by @dependabot in #466
• Update testcontainers requirement from <4.10 to <4.11 by @dependabot in #467
• Update ruff requirement from <0.12 to <0.13 by @dependabot in #465
• CDC: Enable standalone loading of DMS events from Kinesis streams and stream-dump files by @amotl in #450

New Contributors

• @kneth made their first contribution in #438

Full Changelog: v0.0.35...v0.0.36

v0.0.35

What's Changed

• Added lost pytest dependencies to cratedb-toolkit[testing] by @amotl in #437

Full Changelog: v0.0.34...v0.0.35

v0.0.34

What's Changed

• Downgrade to sqlalchemy-cratedb 0.41, version 0.42 is not GA yet by @amotl in #436

Full Changelog: v0.0.33...v0.0.34

v0.0.33

What's Changed

• CFR: Enhanced job statistics with optional reporting database support. Thanks, @WalBeh.
• Settings: Added settings comparison utility. Thanks, @WalBeh.
• Meta: Added parser for https://cratedb.com/releases.json file. Thanks, @WalBeh.
• CFR: Added the ability to anonymize queries recorded by collect
• Cloud API: SDK and CLI for CrateDB Cloud Cluster and Import APIs
  Supports headless/unattended operations on CrateDB Cloud clusters, covering
  deploy/start/resume and data import procedures using fluent API and CLI
• Cloud API: Added JWT authentication to client API and ctk shell
• Cloud API: Added health and ping subcommands to ctk cluster
• CLI: Downgraded to Click 8.1, as the code is not compatible with 8.2 yet

Details

• Enhance job statistics commands with optional reporting database support by @WalBeh in #418
• Settings: Add settings comparison utility by @amotl in #421
• Update polars requirement from <1.28 to <1.29 by @dependabot in #425
• Update botocore requirement from <1.38 to <1.39 by @dependabot in #427
• Update pyarrow requirement from <19.1 to <20.1 by @dependabot in #426
• Meta: Add parser for https://cratedb.com/releases.json file by @amotl in #430
• Bump python from 3.11-slim-bookworm to 3.13-slim-bookworm in /release/oci by @dependabot in #293
• Update aiobotocore requirement from <2.22 to <2.23 by @dependabot in #433
• Update polars requirement from <1.29 to <1.30 by @dependabot in #434
• Anonymize sql statements by @WalBeh in #428
• SDK and CLI for CrateDB Cloud Cluster APIs by @amotl in #81
• CLI: Downgrade to Click 8.1, as the code is not compatible with 8.2 yet by @amotl in #435

Full Changelog: v0.0.32...v0.0.33

v0.0.32

What's Changed

• MCP: Add subsystem providing a few server and client utilities through
  the ctk query mcp {list,inquire,launch} subcommands.
• Docs API: Added extractors for CrateDB functions and settings
• Connect: Respect sslmode URI parameter when converting SQLAlchemy
  connection URLs to http(s)://

Details

• Chore: Update to "verlib2<0.3" by @amotl in #366
• Update black[jupyter] requirement from <25 to <26 by @dependabot in #365
• Update polars requirement from <1.22 to <1.24 by @dependabot in #372
• Update boltons requirement from <25 to <26 by @dependabot in #371
• Update mypy requirement from <1.15 to <1.16 by @dependabot in #370
• Update duckdb requirement from <1.2 to <1.3 by @dependabot in #367
• Update marimo requirement from <0.11 to <0.12 by @dependabot in #369
• Update polars requirement from <1.24 to <1.25 by @dependabot in #376
• Update aiobotocore requirement from <2.20 to <2.22 by @dependabot in #373
• Update verlib2 requirement from <0.3 to <0.4 by @dependabot in #374
• Bump cratedb-sqlparse from 0.0.10 to 0.0.13 by @dependabot in #375
• Chore: Relax dependency on poethepoet and pyproject-fmt by @amotl in #378
• Update ruff requirement from <0.10 to <0.12 by @dependabot in #382
• Update python-bsonjs requirement from <0.6 to <0.7 by @dependabot in #383
• Dependencies: Relax version constraints for development tools by @amotl in #384
• Update polars requirement from <1.25 to <1.27 by @dependabot in #385
• Update kaggle requirement from <1.7 to <1.8 by @dependabot in #386
• CI: Add software testing for Python 3.8 and 3.9 by @amotl in #391
• Update rich requirement from <14,>=3.3.2 to >=3.3.2,<15 by @dependabot in #390
• Update yarl requirement from <1.19 to <1.20 by @dependabot in #393
• Update marimo requirement from <0.12 to <0.13 by @dependabot in #394
• MCP: Subsystem providing a few server and client utilities and documentation about detailed API capabilities by @amotl in #392
• MCP: Update to mcp-alchemy GA from PyPI by @amotl in #395
• TEMP: Update to "sqlalchemy-cratedb>=0.42.0.dev2" by @amotl in #389
• MCP: Add mcp-db, mcp-dbutils, and postgres-mcp servers, just enumerating by @amotl in #396
• Project: Improve configuration for versioningit, allow Zip-only setup by @amotl in #397
• Docs API: Add CrateDB settings extractor by @amotl in #398
• Docs API: Integrate into CLI. Add documentation. by @amotl in #399
• Docs API: Use stdout by default. Add YAML output format. by @amotl in #400
• Docs API: Add CrateDB functions extractor by @amotl in #401
• Docs API: Refactoring and refinement by @amotl in #406
• Update polars requirement from <1.27 to <1.28 by @dependabot in #403
• Update botocore requirement from <1.37 to <1.38 by @dependabot in #404
• MCP: Improve documentation by @amotl in #407
• Connect: Respect sslmode URI parameter by @amotl in #408
• Update yarl requirement from <1.20 to <1.21 by @dependabot in #410
• Update marimo requirement from <0.13 to <0.14 by @dependabot in #411
• Chore: Fix import woes by @amotl in #414

Full Changelog: v0.0.31...v0.0.32

v0.0.31

What's Changed

• Fixed connectivity for jobstats collect
• Refactored code and improved CLI interface of ctk info vs. ctk cfr
• Dependencies: Updated to crate-2.0.0, which uses orjson for JSON marshalling
• CFR: Job statistics and slow-query exploration per Marimo notebook. Thanks, @WalBeh.

Details

• Update ruff requirement from <0.9 to <0.10 by @dependabot in #345
• Fix connectivity for job-statistics collect by @amotl in #347
• Improve CLI interface of ctk info vs. ctk cfr, and documentation by @amotl in #348
• Update to crate-2.0.0, which uses orjson for JSON marshalling by @amotl in #349
• Dependencies: Update to crate>=2.0.0.dev6, restoring JSON marshalling by @amotl in #351
• This and that: Format code and improve test case by @amotl in #352
• Update pyarrow requirement from <18.2 to <19.1 by @dependabot in #353
• Update polars requirement from <1.20 to <1.21 by @dependabot in #354
• Update aiobotocore requirement from <2.18 to <2.19 by @dependabot in #355
• Chore: Maintenance 2025W05 by @amotl in #359
• Datasets: Register UK wind farm dataset by @amotl in #360
• Datasets: Register Chicago datasets by @amotl in #361
• Dependencies: Update to sqlalchemy-cratedb>=0.41.0 (GA) by @amotl in #362
• CFR job statistics and slow-query exploration: First draw of marimo notebook by @WalBeh in #350

New Contributors

• @WalBeh made their first contribution in #350

Full Changelog: v0.0.30...v0.0.31

v0.0.30

What's Changed

• Dependencies: Minimize dependencies of core installation,
  defer polars to cratedb-toolkit[io].
• Fixed cratedb-wtf record about too large values of ulimit_hard
• Improved ctk shell to also talk to CrateDB standalone databases
• Added basic utility command ctk tail, for tailing a database
  table, and optionally following the tail
• Table Loader: Added capability to load InfluxDB Line Protocol (ILP) files
• Query Collector: Now respects CRATEDB_SQLALCHEMY_URL environment variable
• Updated dataset loading URLs. Thanks, @simonprickett.

New Contributors

• @simonprickett made their first contribution in #339

Full Changelog: v0.0.29...v0.0.30

v0.0.29

What's Changed

• MongoDB: Added Zyp transformations to the CDC subsystem,
  making it more symmetric to the full-load procedure.
• Query Converter: Added very basic expression converter utility with
  CLI interface
• DynamoDB: Added query expression converter for relocating object
  references, to support query migrations after the breaking change
  with the SQL DDL schema, by v0.0.27.

Full Changelog: v0.0.28...v0.0.29